Feedback control in a collective flashing ratchet 
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An ensemble of Brownian particles in a feedback controlled flashing ratchet is studied. The 
ratchet potential is switched on and off depending on the position of the particles, with the aim of 
maximizing the current. We study in detail a protocol which maximizes the instant velocity of the 
center of mass of the ensemble at any time. This protocol is optimal for one particle and performs 
better than any periodic flashing for ensembles of moderate size, whereas is defeated by a random 
or periodic switching for large ensembles. 



PACS numbers: 05.40.-a, 02.30.Yy 

Rectification of thermal fluctuations is becoming a ma- 
jor research topic in non equilibrium statistical mechan- 
ics, with potential applications in biology, condensed 
matter, and nanotechnology 

Most of these rectifiers or Brownian ratchets work by 
introducing an external time-dependent perturbation in 
an asymmetric equilibrium system. In the case of rock- 
ing ratchets, the perturbation is an AC uniform field, 
whereas for the flashing ratchet 0, 0| the perturbation 
consists of switching on and off an asymmetric sawtooth 
potential, such as the one depicted in Fig. ^ (left). 

The models and applications studied so far have been 
focused on periodic or random time-dependent perturba- 
tions 0. On the other hand, in this Letter we study a 
feedback controlled ■perturbation, i.e., an external force de- 
pending on the state of the system. Introducing control 
in Brownian ratchets is relevant for the aforementioned 
applications. Feedback control could be implemented in 
systems where particles are monitored, as occurs in some 
experimental setups with colloidal particles |5|. Control 
theory is also of extreme relevance in biology 0, , and 
mostprotein motors probably operate as control systems 
(see |g for a specific example). Finally, controlled ratch- 
ets are relevant from a theoretical point of view. The 
idea of rectifying thermal noise was originally introduced 
by Smoluchowski and Feynmann ^3 in relation to 
the Maxwell demon. Recently, Touchette and Lloyd have 
pointed out that the original Maxwell demon can be con- 
sidered a feedback control system and found that ther- 
modynamics imposes some limitations to control [lH . 

Using controlled Brownian ratchets one can build mod- 
els to check these limitations and understand how in- 
formation can be used to increase the performance of a 
system. For instance, it is not hard to prove that some 
single-particle ratchets become Maxwell demons if infor- 
mation on the position of the Brownian particle is avail- 
able In this Letter we will study the more involved 
problem of a collective fiashing ratchet, focusing on the 
induced current of particles. 

Consider a fiashing ratchet 0, 0| consisting of a Brow- 



nian particle in an asymmetric sawtooth potential, such 
as the one depicted in Fig. (left). If the potential is 
flashed in a periodic or random way, the particle exhibits 
a systematic motion to the right 0, 0, 0]- However, if 
we know where the particle is at any time, there is a 
better switching strategy. We could switch on the poten- 
tial whenever the force is positive and switch it off if the 
force is negative. Under this switching protocol, the par- 
ticle feels the effective non periodic potential depicted in 
Fig. n (right) . Obviously, the particle moves to the right 
and this is the optimal switching policy, inducing larger 
currents than any periodic or random switching. 
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FIG. f : The ratchet potential {lef£) and the corresponding ef- 
fective potential for the one-particle controlled ratchet {right), 
both for Vo = SfcT and o = 1/3. (Units L = 1, D = 1 and 
kT = 1.) 

The problem of control becomes less trivial for ratch- 
ets consisting of many particles. Control strategies can 
induce an effective coupling among particles and the sys- 
tem becomes a coupled Brownian motor ^Llj . 

Consider an ensemble of N overdamped Brownian par- 
ticles at temperature T in an external asymmetric peri- 
odic potential V{x), that can be either on or off. The 
dynamics is described by the Langevin equation: 



-ix,{t) = a{t)F{x,{t)) + ^,{t) ■ 



1. 



■ N, 



(1) 



where Xi{t) is the position of particle i, 7 is the friction 
coefficient and S,i{t) are thermal noises with zero mean 
and correlation {S,t{t)^j{t')) = 2-/kTS^J6{t-t'). The force 
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is given by F{x) = —V'{x) where V{x) is a periodic, 
V{x + L) = V{x), asymmetric potential defined by 

F(,t) = I, (2) 
._^1_(£.„)+,, .fa<i<l 

and depicted in Fig. left. Finally, a(t) is a control 
parameter which we assume that can take on the values 
1 and 0, i.e., the only allowed operations on the Brownian 
motor consist of switching on and off the potential V{x). 
We will consider the following two switching strategies: 

• Periodic switching: a(t + r) = a(t), with a{t) = 1 
for t e [0,t/2), and a(t) = for t e [t/2,t). This 
case is equivalent to the periodic flashing ratchet 
0,0, since particles are independent. 

• Controlled switching: 

«W = e(/(i)) with /(i) = _^F(a;.(t)), (3) 

i=l 

where f{t) is the net force per particle and 6(y) 
is the Heaviside function, 8(?/) = 1 if y > and 
otherwise. As can be deduced from Eq. (Q), this 
strategy maximizes the instant velocity of the cen- 
ter of mass, XcTn{t) = jfJ2iLi^ii^)- Particles are 
no longer independent, due to the feedback control 
©(/(*))■ 

We first compare numerical results for the two switch- 
ing strategies described above. In Fig. |21 the center of 
mass velocity is plotted as a function of N for the pe- 
riodic switching with the optimal period 
and for the controlled switching, both for Vq = bkT and 
a~ 1/3. For this potential, the optimal period has been 



found to be Topt — 0.05L^/D, giving 



0.29D/L. 



The controlled switching yields a higher velocity than the 
periodic strategy only up to a certain N {N ~ 1300 for 
the previous values of the parameters). We also see from 
simulations that the velocity goes to zero when N oo, 
in the controlled case. This is surprising at first sight, 
because the controlled strategy given by Q maximizes 
the instant velocity icm{t). However, this local maxi- 
mization does not ensure good results in the long term, 
as we have already shown for the so-called paradoxical 
games and other deterministic systems |l5| . 

The case = 1 can be solved analytically, since 
it consists of a single particle moving in the effective 
potential depicted in the rightmost plot of Fig. as 
mentioned above. The corresponding stationary Fokker- 
Planck equation can be solved, yielding 
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FIG. 2: Average of the speed of the center of mass, (icm), 
for simulations of the periodic switching with optimal period 
Topt ~ 0.05L^ /D (dashed line); simulations of the controlled 
ratchet (circles with error bars); the binomial approximation, 
Eq. 0, (solid line); and the large N approximation, Eq. I12L 
(dotted line); all for Vb ~ 5kT and a — 1/3. (Units L — 1, 
_D = 1 and fcT = 1.) 



where D — kT/j is the diffusion coefficient. For Vq — 
bkT and a = 1/3, this yields a stationary speed {x)st — 
A.27D/L, more than 10 times larger than the highest 
speed obtained with a periodic switching. For = 1, in 
fact, this controlled switching is clearly optimal. 

For arbitrary N, by summing and averaging the 
Langevin equations with the prescription (PJ , one ob- 
tains the following exact equation for the mean velocity 
of the center of mass: 



1 



icm(i)> = -(e(/(i))/W). 
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(5) 



The net force per particle f(t) can be written in terms 
of the number n{t) of particles in the interval [0, aL]. 
Notice also that the system reaches a stationary regime, 
because there is not any explicit dependence on time in 
the controlled switching case. 

The average in the r.h.s. of Eq. Q can be approxi- 
mately computed in the stationary regime making the fol- 
lowing two assumptions: (i) particles are statistically in- 
dependent (i.e., the stationary distribution has the form 
Pst{xi,X2, ■ ■ ■ ,xn) = riiliPstl^O) and (ii) the proba- 
bility that a given particle is in the interval [0, aL] is a. 
These are reasonable assumptions since both are fulfilled 
by the two equilibrium distributions corresponding to re- 
spectively switching on and off for a long period of time. 
Under this approximation, the probability distribution of 
the random variable n(t) is a binomial distribution in the 
stationary regime and the average velocity becomes 



N 

E 

n<Na 



n N — n 
a 1 — a 



N 



a"(l-a) 



TV- 



(4) 



(6) 

This binomial approximation, Eq. (|SJ|, has been tested for 
various values of Vq and a giving good results for small 
N (see Fig. 12). Eq. ® is in fact exact for TV = 1 in 



the limit Vo/{kT) [as can be proven from Eq. Q]. 
This is expected since the equilibrium distribution is then 
almost uniform both for the on and off potentials. As 
a consequence, the binomial approximation gives better 
results when decreasing V()/{kT), not only for iV = 1, but 
also for > 1. 

For sufhciently large values of N (> 10), the binomial 
distribution can be approximated by a Gaussian, yielding 

1 /'OC r ,9 

(ic„.),t ^ ^== / d/e(/)^e-3&= (7) 
V2TTa^ J_oo 7 7V27r 

with cr2 = V^/[L^a{l ~ a)N\. 

One can study within this approximation the following 
general mixed strategy depending on /(t): the potential 
is switched on with a probability Pon(/(i)), and switched 
off with probability 1 — Pon{f{t)). Under the gaussian 
approximation, the stationary velocity for this protocol 
is the same as in Eq. {7} but replacing 6(/) by Pon(/)- 
Then it can be easily seen that the gaussian approxima- 
tion predicts that the optimal strategy is the one consid- 
ered in this paper, i.e., Ponif) = ©(/)• However, this is 
not true for large N (see Fig. 

The binomial and the gaussian approximations fail in 
other respects for large values of N. Both give (icnOgt 
l/ViV, whereas numerical simulations show that (icm)st 
decays more slowly. 




FIG. 3: A = 10 : Time dependence of the net force per 
particle f{t) (left) and the average position of the center of 
mass (xcmit)) (right). Colored background indicates the off- 
potential time intervals. Both figures are for Vo = 5kT, a = 
1/3. (Units: L = 1, _D = 1 and fcT = 1.) 

For large iV, numerical simulations reveal that the sys- 
tem gets trapped near the equilibrium distribution of 
either the on or the off potential, and switches are in- 
duced only by fluctuations of the net force per parti- 
cle f{t). This behavior is shown in Fig. 13 where the 
evolution of f{t) and (xcm(i)) is depicted for N = 10^. 
These fluctuations decrease with N, then so does the fre- 
quency of switches, yielding (icm) for N oo. 
Therefore, the system almost reaches the equilibrium 
distribution of each dynamics. These equilibrium dis- 
tributions for the on and off potential are, respectively, 
Pst,on(a:) = e.-^^'^'^l^'^ jZ and Pst,off(a;) = 1/^, where Z is 
a normalization constant. 
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FIG. 4: N ^ oo: Net force per particle /°=(t) = (F{x)) as 
a function of time, for Vo = 5fcT, and a = 1/3, and for the 
two cases: Lejt: a.{t') = 1 (potential on) and initial condi- 
tion given by the equilibrium profile for a flat potential, i.e., 
Pst,off(a;); and right: a{t) = (potential off) and initial con- 
dition given by the equilibrium profile for a ratchet potential, 
i.e., pst,oii(a;). (Units L = 1, D = 1, and kT = 1.) 

To gain some quantitative insight, let us consider the 
case N = oo (no fluctuations). In this case, the dis- 
tribution of particles coincides with the solution of the 
following mean-field Fokker-Planck equation: 

jdtp{x, t) = [-a{t)d.,F{x) + kTdl] p{x, t), (8) 

where a{t) = e(/°°(t)), /°°(t) = {F{x)), and the aver- 
age (.) is taken over p{x, t). 

We have studied the evolution of p{x, t) in two situa- 
tions: (i) a{t) = 1 (potential on) with initial condition 
given by yOst,off(a^) — l/L and (ii) a{t) — (potential off) 
with initial condition given by Pst,on{x). We have calcu- 
lated the average force f°^{t) as a function of time by 
a numerical integration of the Fokker-Planck equation. 
The results are plotted in Fig. 0] When the potential is 
switched on, the particles in the negative force interval 
(where the force is stronger due to the asymmetry of the 
potential) arrive earlier at the minima. This leads to an 
initial increase in the net force per particle, f°°{t). [A 
similar interpretation can be given to Fig. 0] (right).] 

For large but finite N, f{t) fluctuates around f°°{t) 
(cfr. figures 13 and 0}, i.e., f{t) = f°°{t) + fluctuations. 
Due to these fluctuations, f{t) crosses zero and switches 
are induced. In fact, for large N the controlled ratchet 
behaves as an excitable system: fluctuations induce the 
switches and, after one of these switches, the system has 
to perform a large excursion for the force to go back to a 
small value, suitable for a new "excitation" . This picture 
allows us to calculate (icm) for large N. For N finite, the 
fluctuations of f{t) are of order ^y {F'^)cq/N. Therefore, 
a switch is possible whenever 

\r(t)\^^l^^. (9) 

In our case, fluctuations are the same for the on and off 
situations: {F^)cq = V^/[L'^a{l - a)]. 

On the other hand, f°°(t) departs rapidly from zero, 
reaches a maximum and finally exhibits an exponential 
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decay, both for the on and off cases (Fig. 01 left and right, 
respectively). Therefore, in each case 

/otoff(0 = an,offe^^"-«(*-^™'-), (10) 

where Con, off are constants, Ton, off are the transient times 
of each dynamics, and 1/ Aon, off are the characteristic 
times of the corresponding exponential decays. Combin- 
ing Eqs. and (|10|) . one obtains the following switching 
time: 

IniV 

ion, off — Con. off + ^TT , (H) 

^Aon,off 

where Con,off are constants depending on the transient 
regime of each dynamics. 

Finally, the center of mass only moves when the po- 
tential is on, covering a distance Axon, as shown in Fig.|31 
(right) , (when the potential is off, the evolution is purely 
diffusive and Axoff =0.) Thus, the average velocity of 
the particles is 

/ . \ AXon AXon ^ir>\ 

ton + tos b + dlnN 

where b = Con+Coff and d = (Aon+Aoff)/(2AonAoff). Every 
parameter in Eq. H12|l can be obtained from the numerical 
integration of the corresponding Fokker-Planck equation 
for N — oo. We have performed such an integration 
for Vo = 5kT and a = 1/3, yielding Axon = 0.047L, 
Aon = 40£i, Aoff = 39£i and b = -0.071D-^. Theory 
and numerical simulations show a good agreement for 
large values of N (see Fig.|21). This good agreement has 
also been verified for other values of Vq, a, and for other 
potential shapes, for example V{x) = Vo[sin(27ra;/L) -I- 
sin(47ra;/L)]. 

It is interesting to note that the advance Axon is 
mainly covered during a transient time. Ton, that is of 
the order of half the optimal period for periodic switch- 
ing. Longer switching periods, as we have in the present 
controlled ratchet for large N, lead to lower performance. 
On the other hand, for small N the controlled ratchet 
manages to use the information provided by / to do ad- 
equate faster switches and increase performance. 

Notice that the feedback control studied in this Letter 
is itself a rectification mechanism. Hence, for a ^ 1/2, 
there are two sources of spatial asymmetry in our system: 
the feedback control and the shape of the ratchet poten- 
tial. Feedback control induces a net flux even for sym- 
metric potentials, a ~ 1/2. In this case, f°°{t) — and 
one only has to consider the fluctuations in /(t). Con- 
sequently, the binomial approximation works well even 
for large values of N. Introducing an asymmetry in the 
potential, a < 1/2, favors the flow of particles for any N 
and changes the large N behavior of (xcm) from l/\/7V 
to 1/lniV [cfr. Eqs. and ((1^]. 

Summarizing, we have computed the current induced 
in an ensemble of Brownian particles by a potential that 



is switched on and off according to a simple feedback 
strategy maximizing the instant velocity of the center 
of mass, and compared it with the current induced by 
a periodic switching. The results show that, for small 
N, the current is better in the controlled case than in 
the periodic switching, as expected. However, for large 
ensembles the controlled ratchet performs worse than the 
periodic strategy. 

There are a number of open problems prompted by 
our work. First, finding the optimal protocol for A'^ > 1, 
which probably differs from the one considered in this 
Letter. Secondly, we have focused on maximizing the 
current, but it would be relevant to consider also the 
maximization of the efficiency, specially to asses the en- 
tropic value of the information about fluctuations and 
the limitations imposed by thermodynamics to feedback 
control jO]- 
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